Design of BATRUN Distributed Processing System (DPS)
نویسندگان
چکیده
This paper discusses the design of BATRUN Distributed Processing System (DPS). We have developed this system to automate the execution of jobs in a cluster of workstations where machines belong to different owners. The objective is to use a general purpose cluster as one massive computer for processing large applications. In contrast to a dedicated cluster, the scheduling in BATRUN DPS must ensure that only the idle cycles are used for distributed computing and the local users, when they are operating, have the full control of their machines. BATRUN DPS has several unique features: group-based scheduling policy to ensure execution priority based on ownership of machines, multi-cell distributed design to eliminate a single point failure as well as to guarantee better fault tolerance and scalability. The implementation of the system is based on multi-threading and remote procedure call mechanism. This paper focuses on the design of BATRUN DPS and its components: Machine Allocator, Job Scheduler, Resource Collector, Execd, User Process Agent and Keyboard Monitor.
منابع مشابه
Design of BATRUN Distributed Processing System
This paper discusses the design of BATRUN Distributed Processing System (DPS). We have developed this system to automate the execution of jobs in a cluster of workstations where machines belong to different owners. The objective is to use a general purpose cluster as one massive computer for processing large applications. In contrast to a dedicated cluster, the scheduling in BATRUN DPS must ens...
متن کاملCost Optimization for Allocation of Tasks to Processors in a Distributed Processing System
AbstractDistributed Processing System (DPS) consists of one or more applications spread over several computer systems to solve some computational problems. Task allocation refers to the allocation of tasks to processors before commencement of their execution. The challenge of allocation is predicting the execution behavior of a system and partitioning tasks to processors in a way that there sho...
متن کاملA Multiagent System-approach for the Design of Information Systems in Virtual Organizations
This paper presents a design approach for information systems of virtual organizations which is based on the Distributed Artificial Intelligence (DAI) concept of Multiagent Systems (MAS). Viewing information retrieval within modern organizations as an inherently distributed problem we first evaluate in how far the main DAI architectures (Distributed Problem Solving (DPS), Cooperative Distribute...
متن کاملDecentralization of a Multi Data Source Distributed Processing System Using a Distributed Hash Table
A distributed processing system (DPS) contains many autonomous nodes, which contribute their own computing power. DPS is considered a unified logical structure, operating in a distributed manner; the processing tasks are divided into fragments and assigned to various nodes for processing. That type of operation requires and involves a great deal of communication. We propose to use the decentral...
متن کاملData Processing System (DPS) software with experimental design, statistical analysis and data mining developed for use in entomological research.
A comprehensive but simple-to-use software package called DPS (Data Processing System) has been developed to execute a range of standard numerical analyses and operations used in experimental design, statistics and data mining. This program runs on standard Windows computers. Many of the functions are specific to entomological and other biological research and are not found in standard statisti...
متن کامل